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Abstract 

(n) 

Let p n , n € N, be the nth orthonormal polynomial on R, whose zeros are A,- 



j = 1, . . . , n. Then for each j = 1, . . . , n, 
with 



\fc=0 



defines a discrete probability distribution. The Shannon entropy of the sequence {p n } is 
consequently defined as 



In the case of Chebyshev polynomials of the first and second kinds an explicit and closed 
formula for S n j is obtained, revealing interesting connections with the number theory. 
Besides, several results of numerical computations exemplifying the behavior of S n j for 
other families are also presented. 
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1 Introduction 

Given a probability Borel measure [i supported on the real line M. with infinite number of 
points of increase, we can build a sequence of orthonormal polynomials p n (X) = K n X n + 
lower degree terms, n = 0,1,2, ... , uniquely determined if all n n > 0, such that 

J Pn(X)p m (X) dfi(X) = 5 nm , m, n = 0, 1, 2, . . . 

* Corresponding author. 
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Beside their importance in approximation theory and multiple branches of applied and pure 
mathematics, orthogonal polynomials constitute a noteworthy object from the point of view 
of the information theory. This interest originated in the framework of the modern den- 
sity functional theory [14} [15] [T9] , that states that the physical and chemical properties of 
fermionic systems (atoms, molecules, nuclei, solids) may be completely described by means of 
the single-particle probability density. For instance, if the solution of the time-independent 
Schrodinger equation in a D-dimensional position space for an single particle system, 

H^(r) = E^{r) , f= (cci, . . . , x D ) , 

is the wave function Vl/(r), then the position density of the system is p(r) = \^(r)\ 2 . Analo- 
gously, the wave function in momentum space ^f{p), which is the Fourier transform of VP(f), 
gives the momentum density 7(p) = ^(p)! 2 . 

Information measures of these densities are closely related to fundamental and experimen- 
tally measurable physical quantities, which makes them useful in the study of the structure 
and dynamics of atomic and molecular systems. For instance, the Boltzmann-Gibbs- Shannon 
(position-space) entropy 

B(p) = — J p{r) log p(r) dr (1) 

measures the uncertainty in the localization of the particle in space. Lower entropy corre- 
sponds to a more concentrated wave function, with smaller uncertainty, and hence, higher 
accuracy in predicting the localization of the particle. The well known inequality [51 El [9] 

B(p) + B(j)>D{l + \ogn) (2) 

is an expression of the position-momentum uncertainty principle, much stronger than the 
renowned Heisenberg relation, that plays a major role in quantum mechanics (see [22]). 

The study of the information measures of orthogonal polynomials is motivated by the 
fact that the densities of many quantum mechanical systems with shape-invariant potentials 
(e.g., the harmonic oscillator and the hydrogenic systems) typically contain terms of the form 
v\p! ■ Explicit formulas, numerical algorithms and asymptotic behavior have been studied 
both for the Boltzmann-Gibbs-Shannon (or differential) entropy 



B n = -J pl{\)\og (p 2 (A)//(A)) dp{\) 
and for the the relative entropy (or the Kullback-Leibler information) 

K n = - / P 2 (A)log(^(A)) dp{\) ; 



see e.g. [3]m El HO] EH EJUS [20] an d the references therein. In particular, it has been shown 
that for Chebyshev orthonormal polynomials of the first kind the relative entropy K n does 
not depend on n, 

K n = log(2) - 1 , 

and that this value is asymptotically maximal among all orthogonality measures on [—1, 1] 
(sec [7J), giving a formal explanation to the intuitive notion that these polynomials arc the 
most "uniformly" distributed ones. 
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However, there are several discrete measures naturally associated with a sequence of 
orthogonal polynomials. The analysis of such measures requires the use of the "genuine" 
entropy studied by Shannon. In order to stress the discrete character of this entropy, hereafter 
we refer to it as Shannon entropy and denote it by the letter S. The evaluation of Shannon 
entropy for discrete distributions is a basic question of information theory (see e.g. [17\ 
18]); unlike for B n and K n , there are no known results for the Shannon entropy of the 
orthogonal polynomials related distributions, due in part to the technical difficulties of the 
explicit evaluation of sums. 

It is well known that the orthonormal polynomials p n satisfy a three-term recurrence 
relation of the form 



Xpi(X) = b i+1 p i+ i(X) + a i+ ipi(\) + &i?>i-i(A) , i = 0, 1, . . . ,n-2. 
Using its coefficients we can define the n x n Jacobi matrix (n 6 N), 



P-i = 0, Po = 1 ■ (3) 



L r . 



( ai bi 

h a 2 



\ 



-2 b n -i 
b n -l CL n J 



(4) 



which determines a self-adjoint linear operator (discrete Schrodinger operator) L n : W 1 — > W 1 
by 

Lei = he i+ i + a^i + 6j_ie*i_i , i = l,...,n, 

where e±, . . . e n is the canonical basis in M n , and we agree that e*o = e n+ \ = 0. Moreover, up to 
a constant factor, p n (X) = det(L n — XI), which shows that the eigenvalues X^\ 
are the zeros of p n , and 



1. 



,n, 



Pk=[po,Pi(xt ) ),...,Pn-i(Xr) 



(n). 



are eigenvectors corresponding to different eigenvalues. 

Let (•, •) denote the standard (euclidean) inner product in W 1 , and 



fn-\ 



-i 



4(A) d = f HT^(A) 



\k=0 



(Pk,Pk) 



(5) 



the n-th Christoffel function. 
If we normalize 



^n(X^) Pk ■ 



•k — V ^nV^fc 

then a consequence of the well known Christoffel-Darboux formula is that 

(*i,*j)=<%> i,j = l,...,n. 
In other words, the n x n matrix 



(6) 



*=Utn(Xf ) )p l - 1 {Xf ) )) n 

V / i, j= i 
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made of columns j = 1, . . . ,n, is orthogonal, so that the squares of the components of 
each (column) vector ^j, j = l,...,n, give a discrete probability distribution, and these 
distributions are mutually orthogonal in the sense of ([6]). 

Recall that given a probability measure /i = (/zi,//2, • • • , A* n ) on a system of n points, e. 
g. Y^j=iH = 1) the standard Shannon entropy reads S([i) = — Y^j=i log^i- By Jensen's 
inequality, 

< S(jj) < log(n) , (7) 

and the maximum of corresponds to a uniform probability distribution. In this sense, it is 
quite natural to think of the Shannon entropy as a measure of uncertainty. 

Remark 1 We can give the following geometric interpretation to the Shannon entropy. 
Given in M n an orthonormal basis {Si}, any vector v S M n has a unique representation 

n 

v= y y {v,ej) S . 
i=i 

Assume that v G S" 1-1 , that is, ||if|| = 1, where || • || means the Euclidean norm. A natural 
way of measuring a relative distance of v from the basis {efj} is by means of the Shannon 
entropy 

n 

S n = -^2pilog(pi) , pi = (ei,v) 2 , i = l,...,n. (8) 

i=l 

Indeed, if v = for a certain k, then pj = djk, and S n = 0. On the contrary, if v is 
"equidistant" from all vectors e^-'s, then all pj = 1/n, and S n attains its maximum, S n = 
log(n). 

Motivated by the discussion above, we introduce the discrete entropy of orthonormal 
polynomials p n , defined as the Shannon entropy of the probability distribution given by each 
column of 

n 

i=i 

n 

= -4(Af) £ Piling (4(Af ) P U(\f)) (9) 

8=1 

= - log (4(Af )) - 4(Af) Plii^f) log (pf-i(Af )) , j = 1, . . . ,n , 

i=l 

which can be generalized as 

n 

S n (X) d = f - log (4(A)) - £ n (X) £ ptiW log (p?_i(A)) , (10) 

1=1 

so that <S n j = <S n (Aj^). 

Unlike the Boltzmann-Gibbs-Shannon entropy, S n does not depend on the weight func- 
tion fi', and is suitable both for discrete and continuous orthogonality (cf. some numerical 
experiments in Section [5]). 
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Remark 2 Since \l/ is an orthogonal matrix, its rows 

UZ^Pi-i^), • • • , V^(A£°)Pi-i(AW) N 
are also orthogonal vectors of W l : 

n ,. 

5ij =X)^( A * n) )P*-i( A fc n) )Pi-i(4 n) ) = / P*-i(A)p i -i(A)d/i„(A) 
fc=i ^ 

where /i n is the normalized counting measure of zeros of p n : 



k=l 

Hence, we may define the dual discrete entropy, corresponding to rows of 

^ = -E^(Af JptiCA^log^Afj^fAW )) , j = l,.. 



,n. 



A basic question of information theory is the evaluation of the Shannon entropy. In this 
paper we compute explicitly the discrete entropy S n j corresponding to Chebyshev orthonor- 
mal polynomials of the first and second kinds. A straightforward interpretation of ([9]) as 
Riemann sums allows to find the first two terms of the asymptotic expansion of S n j for fixed 
j and large n; these terms do not depend on j. However, numerical experiments reveal the 
existence of certain picks, pointing downwards, whose position was not clear a priori (see 
Figure [2]) . The formulas presented below give a complete explanation of this phenomenon 
and exhibit nice connections with relevant objects from the number theory. 

In order to state our results we need to introduce an auxiliary function 

K(x) =ar(*(l-ar) + 27 + *(l + a?)) , x £ [0, 1) , (11) 

where 7 is the Euler constant, and ^f(x) = T'(x) /T(x) is the digamma function. Alternatively, 
1Z can be given by its Taylor series expansion, absolutely convergent for \x\ < 1 (cf. formula 
(6.3.14) in [lj), 

00 

U{x) = -2^C(2A: + l)x 2fc+1 , (12) 

k=l 

where £(•) is the Riemann zeta function. 

Recall that Chebyshev polynomials of the first kind are given by the explicit formula 

p m (\) = T m (\) = \\ lf ,r = °' A = cosfl. (13) 

I V2 cos(m^), otherwise, 

They are orthonormal with respect to the weight 

w(\) = - — on [-1,11. 
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Theorem 1 Let n G N, j € {1,2, ...,n}. For orthonormal Chebyshev polynomials of the 
first kind, the discrete entropy has the following expression: 



S nJ = logn + log2-l + ^+ft(^- 

n \ In 



Hereafter GCD stands for the greatest common divisor. 



d= GCD(2j -l,n) 



Remark 3 Observe that coefficients in the series expansion (|12p are all positive, so that 
1Z{x) < and is strictly decreasing for x £ (0, 1) (see Figure [I]). Since 1 < d < n, we see that 




Figure 1: Function lZ(x), for x G [0, 1/2]. 



lo 2 

max S nJ = log n + log 2 - 1 + - 2 C(2A: + 1) ( ^- ) 



iG{l,2,...,n} 



/I 



k=l 



^ \2k+l 

2nJ 



attained when GCD(2j — 1, n) = 1. Furthermore, if n is odd, then S n j attains its minimum 

log 2 



min S n j = log n — log 2 + 
r {!■-' »;• 



7? 



at a single value j ' = (n + l)/2. It is the only local minimum of S n j if n > 3 is prime. 

The reader can compare these observations with the results of numerical experiments 
shown in Figure [21 
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n=150 




80 100 120 140 160 



Figure 2: Chebyshev polynomials of the first kind: entropy S n j for n = 150, 151 and 152. 

The Chebyshev polynomials of the second kind are 

sin \(m + 1) arccos(A)l sin \(m+ 1)0] , „ . 

p m (\) = U m (\) = l ± r 7 =L= K n = LV . (Q '\ A = cos#, m>0. 14 

VI - A 2 sin(fl) 

They are orthonormal with respect to the weight 

w (\) = - VT - A 2 on [-1,1]. 

7T 



Theorem 2 Lei n £ I, j E {1,2,... ,n}. For orthonormal Chebyshev polynomials of the 
second kind, the discrete entropy has the following expression: 

S n>j = log(n + 1) + log 2 - 1 + n (-^j) , d = GCD(j, n + l). 
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Remark 4 Since 1 < d < n, we see that 

max S n j = login + 1) + log 2 - 1 + TZ [ — — - ] , 
ie{i,2,...,n} \n + lj 

attained when GCD(j, n + 1) = 1. Furthermore, if n is odd, S n j attains its minimum 

mm S n ,j = log — — , 
je{i,2,...,n} V 2 J 

at a single value j ' = (n + l)/2. It is the only local minimum of S n j if n > 3 is prime. 

Remark 5 The leading term logn in both cases shows that the values pg, p\{\^), • • • , 

p,^_ 1 (A^ n ' ) ), normalized by an appropriate factor, are approximately equidistributed. Com- 
paring formulas from Theorem [T] and [2] we see that unlike for the Boltzmann entropy, the 
discrete entropy of the Chebyshev polynomials of the first kind is generally smaller. 

The rest of the article is organized as follows. In the next section (that might have 
an independent interest) we discuss some piece-wise linear endomorphisms of R and their 
connection with permutations. This allows to reduce the analysis of the general discrete 
entropy S n j to some specific values of the index j. A modification of the Euler-Maclaurin 
summation formula is the key to the proof of Theorem [1] in Section [3l The close connection 
between polynomials of the first and second kinds allows us to avoid similar cumbersome 
computations in the proof of Theorem[2]in Section[H Finally, we discuss some numerical result 
obtained for the discrete entropy for other important families of orthogonal polynomials. 



2 Piece-wise linear endomorphism of R and permutations 

The key role is played by the following auxiliary function: 

Definition 3 For each pair of values n,j G N, let ip^\x) denote the linear spline on R with 
nodes at {mn/ j} m£ z interpolating the values 

mn 1 — ( — l) r 
— ,n 



3 1 J ) meZ 



Functions cpj can be explicitly described by 



x G 



2k - 1 2k + 1 
n, n 



for k S Z => ff\x) = \jx - 2kn\ (15) 



(see Figure [3|). 

(n) 

In order to summarize necessary properties of functions 92) we need to introduce some 
notation. We denote by a = b mod (c) the standard arithmetic congruence of a and b 
modulo c, GCD(a, b) stands for the greatest common divisor of integer numbers a and b, and 
No = f N U {0}. We define also the remainder function V : N X N — > Z, by 

^(P; q) = r if and only if — q/2 < r < q/2 and p = r mod (q) 

(note that this definition is shifted with respect to a standard concept of remainder; thus, 
V(p,q) takes also negative values). 

Main Lemma Let n,j S N, with GCD(j,n) = d. 
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(i) We have 



(n) ( n\ \n-ipf\x), if j/d is odd, 
v d / (<Pj \ x ) i v J/d is even, 



and for fc G Z, 

^\k) = d.^/ d d \k). 



(ii) Ifd = n, then <p { "\z) C {0,ra}. 

(iii) If GCD(j, 2n)=d< n, then 

<pf ({l,...,n-l})\{0,n} = {dm: m = 1, . . . , ^ - l} , 
and for any m G { 1, . . . , ^ — 1 } , 

cardj/c G {1, ... ,n — 1} : p^\k) = dm} = d. 

(iv) If GCD(j, 2n) = 2d and d < n, t/ien 

<^ n) ({1, . . . , n - 1}) \ {0, n} = {2dm : m = 1, . . . 



and for any m G {l, . . . , ^f}, 

card{/c € {1, . . . ,n - 1} : <pj n) (fc) = 2dm} = 2d. 

We prove this lemma establishing a number of intermediate auxiliary results. 

Proposition 4 Let n,j G N. Function ip^ : R — > [0, n] satisfies: 

(i) ip^ is even: p^\—x) = p^\x), x G R. 
fwj Symmetry: 

<pf } (x + ^=n-^ n) (x), x£R. 

In particular, tp^ is periodic with period 2n/j. 
(iii) For every either 

pf\x)-jx pf\x)+jx 

— eZ or — G Z . 

2n 2n 

^ For fc G Z, 

»m - 
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Figure 3: 


Functions 




,x€ [0,6], 


for j = l,.. 


.,6. 



Proof. Property (i) is obvious from construction. By (|15p . if x G 
k € Z, then 

2kn — jx, if x 6 



2fc - 1 2fc + 1 
n, n 



for 



2Jfe - 1 2fe 
n, — n 



In particular, if x G 



2Jfe - 1 2/c 
re, — re 

J 3 



jx — 2kn, if x £ 
, then x + n/j £ 



2k 2k + 1 
— n, n 

3 3 



2k 2k + 1 
— re, n 

3 3 



Thus, 



(x + n/j) = j ( x H — ) — 2/cra , ( / 2 ( ; n ' ) fx) = 2£;re — jx . 
3 \ 3 J 



and (1221) follows. The case x £ 



2k 2k + 1 
— n, n 

i i 



is analyzed analogously. 



Identity (123f) is a straightforward consequence of the explicit formula (|15p . 

Assume that k £ 7* and T>(jk, 2n) = r; it means that there exists i £ Z such that 
r = jk — 2nt £ [— n,n). Thus, |2?(j/c,2n)| = |j/c — 2nt\. Furthermore, from the inequalities 
— n < r < r it follows that 

2t - 1 . , 2t - 1 



■ n < /c < 
J J 

(n) 



n . 



Comparing it with the definition of <p\ in (|15|) . we establish 



□ 
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Although function tpj is well defined on whole R, we will be mainly interested in its values 
on the interval [0, n]. In particular, we need to study how cpj acts on integers 1, 2, ... n — 1: 



Proposition 5 Let n,j G N with GCD(j,n) = 1. 

(%) For any j G N, <pf\z) C {0, 1}. 
(ii) If n > 1 and j is odd, then 



iff : {!,...,«- n-1} 



is a bijection. In other words, (pj acts as a permutation on the set {1, . . . ,n— 1}. 



(raj 7/n > 1 and j is even (and thus n is odd), then 



iff : U, . . . , ^ f -» <j 2m : m = 1 



n — 1 1 f„ „ n — 1 



2 

and 

: {"~y~'---' n ~ X } ~* { 2m : m = 1,,,, '"~2~ : 

are bijections. 

Proof. By construction, ipj{k) G {0, n} if and only if fc = mn/j, with m G Z. Since 

GCD(j, n) = 1, mn/j G Z only if m is a multiple of j. Hence, (fj\k) G {0, n} if and only if 
k G {mn : m G Z}. With n = 1 this yields (ij. Furthermore, if n > 1, then 

({l,...,n-l})G{l,...,n-l}. 

Hence, in order to prove (ii) it is sufficient to show that is injective on {1, . . . ,n — 1}. 
Indeed, by ([25]) . <py\x) = r if |D(jx,2n)| = r, that is, if there exists u G Z such that 

j'x ± r = 2nn , 

with an appropriate choice of the sign. Thus, if ip^ l \x) = (p^\y), then there exists u G Z 
such that 

j(a;±y) = 2nn, 

again with an appropriate choice of the sign. However, since j is odd and GCD(j, n) = 1, 
we conclude that GCD(j, In) = 1. This means that x db y must be divisible by 2n. But 
|x ± n| < 2n, so this identity is possible only if x = y. 

If j is even, then a similar analysis shows that k — > |2?(jfc/2, n)| is injective both on 

n- 11 , f n + 1 
It remains to use that by (J2J), <pf\k) = 2 |2?(jfc/2, n)| , k G Z. This establishes fmj. □ 
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Proposition 6 Let m, n G N, and GCD(m, n) = d. Then 

GCD(m,2n) = d 44> m/d is odd, 

and 

GCD(m,2n) = 2d 44> m/d is even, and n/d is odd. 

Proof. Assume that d = 1. It is obvious that GCD(m,2n) = 1 only if m is odd, and 
viceversa, if m is odd and GCD (m, n) = 1, then necessarily GCD (m, 2n) = 1. 

Analogously, if GCD(m, 2n) = 2, it means that m is even, and since m and n are coprime, 
n must be odd. The reciprocal is also trivially true: if m is even and GCD(m,n) = 1, then 
also GCD(m/2,n) = 1, and 

GCD(m, 2n) = 2 • GCD(m/2, n) = 2 . 
The general case is reduced to d = 1 by observing that 

(777 77 \ 
— ,-J = 1. 

□ 



Now we are ready to prove the main result of this section. 
Proof of the Main Lemma. Formula (|17p is a straightforward consequence of (|24p . Since 

(n) / . n\ (n) f n j 

$ K x+ d)=^ [ X + Jd 

formula (|16p follows from f)22[) . 
Since 

GCD(j,n)=d =}► GCD^,^=1, 

we can apply Proposition [5] to function yr.^ . In fact, statement (ii) is a straightforward 
consequence of (i) of Proposition [5] and formula (117j) . 

Assume that GCD(j, n) = GCD(j, 2n) = d < n; by Proposition [6l j/d is odd. By (ii) of 
Proposition (H 

^f/f : {l,...,n/d-l}^{l,...,n/d-l} 
is a bijection, and by formula (|17p . this is valid also for 

<Pj : {1, . . . ,n/d — 1} — > {dm : m = 1, . . . , n/d — 1} . 

Furthermore, any k G {1, . . . , n — 1} can be represented as 

n 

k = r + m-, m G {0, 1, . . . ,d - 1} , r G {0, 1, . . . , n/d - 1} . 

By (USD, 

(n ) ( n ) / n\ fn-^ n) (r), if m is odd, 

v « 7 I (rj , if m is even. 
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In consequence, for every m G {0, 1, . . . , d — 1}, 



(n) ( Tl n n 1 

ip) ' : <1 + m — ,2 + m — , . . . , (to + 1) — — If —* {dm : m = 1, . . . , n/d — 1} 
J L a a a J 



is a bijection. This proves (|18|) - (|T9j) . 

On the other hand, if GCD(j, 2n) = 2d < 2n, then by Proposition [UJ j/d is even and n/d 
is odd, and by (in) of Proposition 

^={l,...,2^i}-{*»:m-l,...,=^l 

and 

^={=^i,...,»/--i}-{am=m = i,...,=^i 



are bijections, so that by formula (|T7l) . this is valid also for 

^»={l,...,=^i}-{2d> B :m-l,...,=^i 
and 

(n) fn/d + 1 Jo^.™_i "A*" 1 



</3j- : < , . . . , n/d — 1 f — > <j 2<im : m = 1, 



Again, if G {1, . . . ,n — 1}, and 



7Z 

k = r + m-, m £ {0, 1, . . . , d — 1} , r G {0, 1, . . . , n/d - 1} 



we have by ([To]) . 

^ (k) = 9?j ; y + m -J = (r) . 

In consequence, for every m G {0, 1, . . . , d — 1}, 

f ra ) f n n n/d—1 n\ ( n/d—1 
ip) : < 1 + m -, 2 + m -, . . . , - h m d I ^ 1 : m = " " " ' 2 

and 

(n) (n/d + 1 n n , -, n/d — 1 

|_ 5 _+ TO - ) ...,_-l + TO _j- > |2dr*:m = l,...,— ^— 

are bijections. This proves (|2T)j) - ([2"Tj) . □ 

3 Discrete entropy for Chebyshev polynomials of the first 
kind 



From the explicit formulas (|13p for p n is easy to compute that in this case 

tn {A) 2 + 2 sin^ ' 
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and for S n (X) defined in (jlOp we have 

n-l 

S n (X) = - log (4(A)) - £ n (X) ^ ft 2 (A) log ( Pi 2 (A)) 

i=0 

n-l 

= - log (4(A)) - 4(A) ^ ft 2 (A) log (2 cos 2 (i#)(A)) 

i=l 

n— 1 n— 1 

= - log (4(A)) - 4(A) log(2) ^ p 2 (A) - 4(A) lQ g {™s 2 (i6)) 

i=i i=i 

n-l 

= - log (4(A))- 4(A) log(2) (4 X (A)-1) -24(A) ^cos 2 (^) log (cos 2 (»0)) 

so that 

S n (X) = - log (4(A)) + log(2) (4(A) - 1) - 24(A) ]T cos 2 (i0) log (cos 2 (i#)) 

i=l 

Since for Chebyshev polynomials of the first kind and degree n the zeros are 

, j = l,...,n, 



i=i 



n-l 



(25) 



A^=cos 



2>i 



we see that 4(Aj) = 1/n for j = 1, . . . , n. In particular, by ([25]) . in this case 



where 



S n>j = 5 n (Aj n) ) =log^-j + 
(2j - 1)tt 



n\ log 2 2~ 



n-l 



3 dcf 



8=1 



2n 



n n 
i } log [ cos 2 



(2j - 1)tt 



2ri 



(26) 



(27) 



Formulas (|26 |) — (|2T[) reduce the computation of S n j to the analysis of the modified entropy 
S n j. But first we express S n ,j in terms of the auxiliary functions <p]j defined by (|15p . 

Proposition 7 For j E N, 



cos I — —x 

2n 



i 11 H i \ 



x E 



(28) 



In particular, 



n-l 



= J^cos 2 f^Ltik)) log (cos 2 v4j-i( fc ) 



k=l 



2n 



(29) 



Proof. By (|23p . given x E R, either 



^x(x) - (2j - l)x ^x(x) + (2j - l)x 
E Z or — — 



2?i 



2n 
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Hence, there exists m G Z such that either 

71 \ ( 2 i- 1 ) 7r . 7r („). . (2j - l)vr 

— (x = x + irm , or — czr- (x = x + ixm , 

2n ■? V 7 2n ' 2n J V 7 2n 

and (EH) follows. □ 



(n) 

Using the arithmetic properties of ipj established above, we can simplify the expression 
for the modified entropy: 

Proposition 8 Let n E N and j 6 {1, 2, . . . , re}. If GCD(2j - 1, n) = d then 

n + l 



S n ,j 



if 3 



2 



(n/d)-l / _ J N , /TTd \\ ^ 

3 2 ( — k I I , otherwise. 



(n/d)-l f d \ ( 

d cos 2 I — k I log I cos 2 

. ti V2n ; v 



Furi/iermore, 

•S'n.j = Sn,n—j+l ■ (31) 

Proof. Observe that d < n, and for j G {1,2,..., n} we have 

n + l 



d = n 44> j 

Furthermore, any term with index k in the sum (|29|) . for which ip^^^k) 6 {0,re}, vanishes. 
Since GCD(2j — 1, n) = GCD(2j — 1, 2n), formula (|30p follows in a straightforward way from 
(I29|) . (ii)— (iii) of the Main Lemma, and the commutativity of the sum. 
Moreover, 

GCD(2j - 1, n) = GCD(2(n - j + 1) - 1, re) . (32) 

Indeed, let GCD(2j-l,re) = d, so that 2j-l = ds, n = dt, where s,t £ N and GCD(s,i) = 1. 
By a well known characterization of coprime integers, there exists integers x, y such that 
xs + yt = 1. We have 2(re — j + 1) — 1 = (2t — s)d, and 

-x(2t - s) + (2x + y)f = xs + yt = 1 =>- GCD(2t - s, t) = 1 , 

so that GCD(2(n — j + 1) — l,re) = d, which proves (j32j) . In particular, S n j and S njn ~j+i 
share the same value d in ([30]) . which proves (f3Tj) . □ 



Next we find a series representation for S n j: 
Proposition 9 Let n £ N, j £ {1,2, ... , n}, and GCD(2j - 1, re) = d. T/terc 



-S„, = -(l-2 l0 g2) + £c(2 S + l) (^) 



2s+l 

(33) 



where £(•) is the Riemann zeta function. 

Remark 6 Observe that d/2n < 1/2, so that the series in the right hand side is convergent. 
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Proof. In order to find the value of S n j we follow the strategy [3] of computing for < 
2 — e < q < 2 + e the l q norms 



n/d-l 



w/(2h)-l 



COS 9 (/lj) , /l = ^ , 



(34) 



3=0 x ' j=0 

and considering the partial derivative of N(q; h) with respect to q at q = 2: 



w /(2h)-l 

S nj = 2d ^ cos 2 (hj) log cos (/y) = 2d -K~N(q; h) 
j=0 



(35) 



g=2 



Observe that N(q; h) are related to the Riemann sums of an integral: 

r-n/2 



hN(q;h) 



cos 9 (u)du 



^2 /cosMV /vr 



it 



— — U ) cfai . 



(36) 



Consider cos 9 (x) and (cos(x)/(7r/2 — x)) 9 as analytic functions at x = and x = vr/2, 
respectively, whose single valued branches in the corresponding neighborhoods are fixed by 



cos y [x 



cos(x) 



\ 2E _ ™ 
2 



x=tt/2 



Denote by 



cos 9 (x) = 1 + y^a s (q). 



8=1 



cos(x) 



) =i+Ea(«)(I 



the Taylor expansions of these functions. Observe that a s (q) = f3 s {q) = for odd indices s. 
The Euler-Maclaurin summation formula for integrals with algebraic singularity at the end 
points (see [23]) yields 



T/(2*)-l r / 2 

hN(q;h)=h V cos q (hj) = h+ cos q (u)du+ 
3=0 Jo 



(37) 



s=0 



s=0 



at this stage we understand this identity in standard terms of an asymptotic expansion. Since 
£(0) = -1/2 and C(— 2j) = for j G N, formula in ([37]) reduces to 



1 1 i" 71 "/ 2 " 

N ^,h) = - + -r / co S q (u)du + ^P2s(q)a-2s-q)h 2s+q 

J® s=0 



(38) 



Paper [23] addresses also the case of the Euler-Maclaurin summation formula providing full 
asymptotic expansion for integrands with logarithmic singularities at the end points. In fact, 
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these results from [23j can be obtained by formal differentiation of (|38p with respect to q. 
Taking into account ([35]) we obtain: 



S nJ =2d—N(q;h) 



But 



and 



so that 



d_ 

8q" ^'' v l9=2 

W rn/2 °° (39) 

cos 2 (u)\og(cos(u))du-2d^2[3 2s (2)('(-2(s + l))h 2( - s+ V . 

s=0 



/ cos (u) log (cos (u))du = — (1 — log 4) , 
Jo 8 

cos 2 (z) _ ^ (_i)«2 2s+1 /vr \2* 
(2^ + 2)! U"' ' 

-l)*2 2s+1 



/? 



/5 2s (2) 



(2s + 2)! 

Recalling the definition of /i and gathering these formulas in (I39p . we obtain 



S --(1 



Identity 

(2sV 1 
C'(-2 S ) = (-1) S C(2 S + 1)- 1 ' 



7T 2s 2 2s +! 

yields now (|33p . It remains to observe that the series in the right hand side is convergent, 
thus this is a bona fide series expansion of S n j. □ 

Corollary 10 Let n € N, j e {1, 2, . . . , n}, and GCD{2j - 1, n) = d, i/ien 



^ nj = l-21og2-^^) . (1.U) 



with 1Z defined in (lllj) . 

Proof. It is an immediate consequence of (j33|) and (|12p , □ 

Remark 7 It is easy to check that 72.(1/2) = 1 — log(4), so that for d = n we have S n j = 
(cf. formula IfgQ])). 



It remains to use ()40|) in ()26[) in order to complete the proof of Theorem [TJ 
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4 Entropy of Chebyshev polynomials of the second kind 

Prom the explicit formulas (|14p it follows that the zeros of the Chebyshev polynomials of the 
second kind of degree n are 



and 



X) = cos ( — — , j = 1, . . . , n , 
n + 1 



n— 1 

1 nsin(#) - cos((n + 1)0) sin(n#) 
C (A) = 2^K-(A) = — u 3 . m — , A = cosfl. 



' 3 W 



(41) 



By (HU), with A = cos(0), 

J^pLi (A) log (pU (A)) = J2pU (A) log (sin 2 (**)) - log (sin 2 (0)) f^Pk-l ( A ) 

fc=l fe=l k=l 

n 

= sin- 2 (0) ^ sin 2 (k9) log (sin 2 (jfefl)) - log (sin 2 (fl)) £~ X (A) 

Introducing the notation 



fc=l 



n-l 



<S n j = 2^ Sm I I 1°S I Sm 



fc=l 



n 



n 



(42) 



and using ([9|) we get 



J 7 \ sm z (j7r/(n + 1)) 



= - log(4(Af } )) + log (sin 2 (jvr/(n + 1))) - . ' S n+1J 

J sm \JTT/(n + 1)) 

Furthermore, by (1111) , 



C(Af) 



n + 1 



2 sin 2 ( -ij. 



that 



(43) 
(44) 

(45) 

Again, formula (|4"5"]) reduces the computation of 5 n)J - to the analysis of the modified entropy 
S n j. We express S n j in terms of the auxiliary functions ipy ' defined by fp~5]> : 

Proposition 11 For j £ N, 



Sn,j = Sn (A^ n) ) = log ( ) - ;77T Sn+lj . 



n + 1 



in particular, 



■ ( ^ \ 






sm — x 




sin 








n-l 







2n 



k=l 



(46) 



(47) 
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Proof. By (|23p . for every x£l either 

— - G Z or — - G Z . 

2ra 2ra 

Hence, given x G R there exists m G Z such that either 

7T („), , jvr vr (n) jvr 

— wa . (x) = — x + irm, or — on m = x + 7rm , 

2n 7 n In J n 

which implies (|46p . □ 
Proposition 12 Lei n G N and j G {1, 2, . . . , n — 1}. T/ien 

'0 ifj = n/2, 

-l 



D sin 2 ( — m ) log (sin 2 ( — m ) ) , otherwise, 



(48) 



m=l 

w/iere L> = GCD(2j,n) and d = GCD(j,n). 
Furthermore, 

Proof. Observe that D < n, and for j G {1, 2, . . . , n — 1} we have 

D = n 44> j = — ■ 
J 2 

It follows from (ii) of the Main Lemma (Section [2]) that in this case ip^' '(Z) G {0, n}, so that 
we obtain formula (|48[) for j = n/2. 

For j ^ n/2 we consider two cases. First, assume that D = 2d. Then, 

GCD(2j, 2n) = 2 ■ GCD(j, n) = 2d = D = GCD(2j, n) . 

Since D < n, by (fT8]) -(fT9l). (pf) ({1, . . . , n - 1}) \ {0, n} = {Dm: m = 1, 1} , and 

for any m G {l,. . . , % - l}, card{/c G {1, . . . , n - 1} : <p^\k) = Dm} = D. Hence, $7} and 
the commutativity of the sum yield 

— -l 

a n V- • 2 (k D \, f • 2 \\ 

b n j = D > sm m log sin m , 

J ^ V2n ; 8 v V2n 

which proves (148 p in this case. 

Assume next that D = d. Then, 

GCD(2j, 2n) = 2 • GCD(j, n) = 2d = 2D = 2 • GCD(2j, n) . 

Since D < n, by (^0])-(pTj). tp$ ({1, . . . , n - 1}) \ {0, n} = ^2Dm : m= 1,...,^^}, and 

for any m G {l,... ,^}, card{£; G {1, . . . , n - 1} : <p^\k) = 2Dm} = 2D. Using (gZJ) and 
the commutativity of the sum, we conclude that 

n/D-l 

m . (50) 



5 nj - = 2D £ sin 2 (— m) log (sin 2 f— : 

m=l \ n J V V n 
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Furthermore, 



so that 



2 / ttD \ 2 ( ttD \ 2 / irD / n 
sin I m J = sin ( vr m J = sin ( y— — m 



n/D-l 

S n ,j = 2D ± sin 2 (£ - m)) log (sin 2 m ))) 



But 



Thus, 



f n/D — 1] fn n/D — 1] r n l 

{m=l,...,-4— ]u|--m:m=l,...,-4— ] = {l,... , - - l} . 

— -l 

b n> j = D sm I m J l°g I sm I m J J j 

which concludes the proof of (|48p . 

Finally, we have that j = ds, n = dt, where s,t £ N and GCD(s,i) = 1. Again by a 
characterization of coprime integers, there exists integers x,y such that xs + yt = 1. But 
n — j = (t — s)d, and 

- s) + (x + y)t = xs + yi = 1 =>- GCD(t - a, t) = 1 , 

so that GCD(n - = d. Analogously, GCD(2j» = D = GCD(2(n - j),n). Now (gSD is 
a straightforward consequence of ((351) . □ 

Next we find a series representation for S^i j : 

Proposition 13 Let n G N, j € {1, 2, . . . , n — 1}, and GCD(j, n) = d. Then 

-S nj - = l-21og2-ft(-) , (51) 

where TZ(-) has been introduced in (llip . 
Proof. Observe first that 



£sin 2 (^m)log( S m 2 (^m 



m=l 

n-1 



sin 2 ^— (n — m)^ log ^sin 2 ^— (n — m) 

m=l 
n-1 

^ C0s2 (£ m ) l0g ( C ° s2 (£ m )) ' (52) 
m=l 
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Let GCD(2j,ra) = D; assume first that D = 2d. By (ggj) and ([52]) . 



2 / 

sm ( — m 

n 



S n j = D ^ sin 2 ( — m j log 

m=l ^ ' 
— -1 

r. V- • 2 \, f • 2 \\ 

= V y sm m log sm m 

= D y cos m log cos m 

m=l x 7 x x 7 7 



= (l-21cg2- K (^) 



where for the last identity we have used (1301) and (l40j) . Since D = 2d, this proves (151]) in this 
case. 

The remaining case is analyzed in a similar fashion. 

□ 

Using (|5ip in (|45p we complete the proof of Theorem [2] 

5 Further numerical experiments 

In this section we present some results of numerical evaluation of the entropy <S nj j for sev- 
eral orthogonal polynomials. Computation has been carried out in Fortran 95, by complete 
diagonalization of the corresponding Jacobi matrix L n in (|4|), using the routine STEVD of 
the L APACK95 library J2] [6] , which computes all the eigenvalues and eigenvectors of a given 
matrix by means of a divide and conquer algorithm [21| . 

As a first illustration we present the entropies S n j, n = 150, 151, 152, for two values of 

the parameters a, of Jacobi polynomials P^ , given by the recurrence relation ([3]) with 



i{i + a)(i + + a + 0) a 2 - (5 



2i + a + P\] (2i + a + (3 + l)(2i + a + (3- 1) ' (2t + a + (3){2i + a + (3 - 2) ' 

In Figured] we can also observe the "peaks" explained for the Chebyshev polynomials, but 
unlike in the latter case, they are pointing both downwards and upwards. Furthermore, the 
value distribution close the endpoints of the interval clearly differs from the behavior in the 
bulk. The feature of the endpoint behavior is even more visible for the symmetric Pollaczek 
polynomials p„(-;a) (Figure [5]), given by the recurrence relation ([3]) with 



_ I / z(i + 2fl-l) _ 
bl ~ 2\/ (i + e + a)( i + 9 + a-l)> ° l " ' 

For a = these polynomials reduce to the Jacobi (or more precisely, Gegenbauer) polynomials 

tQ 1/2 6 1/2) 

Pn ■ If a > 0, the orthogonality weight for the Pollaczek polynomials does not 

satisfy the Szego condition due precisely to its exponentially fast decay at the end points of 
the interval [—1,1]. 
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Jacobi n=150 




A qualitatively different behavior is observed for the Meixner polynomials M„ , given 
by the recurrence relation ([3]) with 

_ (ic(i + P - 1)) 1/2 _ (i-l)(l + c)+c/? 

1 — c 1 — c 

Recall that they are orthogonal with respect to the discrete measure (see e.g. |16t Chapter 
6]) 

k=0 

From Figure[6]we observe that the value of the parameter c has greater impact on the behavior 
of the entropy S n j in comparison with the parameter /3. 
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Pollaczek n=1 50 



Pollaczek n=150 




Finally, the evidence provided by all numerical experiments is sufficiently strong to con- 
jecture that, after an appropriate rescaling and normalization, entropies S n j have a "semi- 
classical" limit as n — > oo. The analysis of this asymptotic behavior is matter of a further 
research. 
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